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Abstract 

2007 was the first international congress on the "square of oppositions" . A first attempt to structure 
debate using n-opposition theory was presented along with the results of a first experiment on the web. 
Our proposal for this paper is to define relations between arguments through a structure of opposition 
(square of oppositions is one structure of opposition). We will be trying to answer the following questions: 
How to organize debates on the web 2.0? How to structure them in a logical way? What is the role of 
n-opposition theory, in this context? 

We present in this paper results of three experiments (Betapolitique 2007, ECAP 2008, Intermed 2008). 

Introduction 

In the era of participatory democracy and web2.0, does a solution to debate exist on the web? Is it even 
possible? Existing solutions are very limited (chats, forums...). Many sites exist, for Web-users to express 
their opinion, but can they build structured arguments and confront them? We try to answer these questions 
by offering new software based on logic. But then, what kind of logic can describe the arguments of a debate? 
What is the role of n-opposition theory? 

In this paper we compare the results of three experiments. First we will introduce some important notions, 
then we will present our experimental protocol and finally we will present detailed discussion system. We 
will also explain how we use the n-opposition theory to structure debate and reason. To conclude, we will 
discuss experiments contexts and results. 

1 Toward a web2.0 debate 



The work we will present began in 2007. Today it is related to the Intermed project. The Intermed project 
aims to provide a set of interoperable tools to debate on the web. This first chapter presents our actual model 
of debate and define some important notions. 



1.1 Modeling 

We did not create any debate model for our first experiment (Betapolitique 2007). All we had was a set of 
documents (political articles of betapolitique website www.betapolitique.fr) and users had the opportunity to 
annotate and express their point of view. We present Annotation in the next part of this chapter. The users 
point of view or argument as we will define it later, comprised part of a text, a judgment and a comment. 

For our second experiment (ECAP 2008 www.lirmm.fr/ECAP08), the documents are the texts of the 
congress speakers. Arguments are more structured and selected text can now be rephrased. 

For our third experiment (the first Intermed experiment), we had the opportunity to work with N.Desquinabo 
(phD in Cemagref UMR G-Eau ). N.Desquinabo thesis is about inter locutivs kinds in TV shows 
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N.Desquinabo tasks in the Intermed project revolve around interlocutivs kinds in debates on web [4]. This 
cohaboration lead us to produce a first relational model based on the following principles : 

• A debate is firstly defined by a subject and reflects a problem (to be resolved or restate . . . ). 

• Each debate is associated with a body of documents called references. 

• Documents can be put in categories. 

• Participants can create group to defend a same opinion. 

• Participants can link arguments to a document. 

• Relations link arguments together. 

Some ideas in le discours acteur du monde by G.Vignaux [9j illusrates our approach. 

• p55 : An argumentation is a set of reasoning to enhance a thesis. It means argumentations are done 
to solve, enhance or defend and an argumentation is firstly defined by a problem. 

• definition of the dialectical discussion p30 quoted by G.Vignaux from the introduction of the Aristotle's 
Topiques by Brunschwig [2j: A two players game; It's a binary opposition, affirmation and negation, 
victory and defeat. 

• p57 : Argumentation consists in confronting arguments and find an issue. 
1.2 Arguments and annotation 

First we present our mecanism to write arguments based on annotation. An argument is a statement sup- 
porting a thesis or against a thesis. A thesis is a point-of-view regarding a debate. A thesis can be, for 
example, an opinion (for or against Nanotechnologies?) or an important conclusion (Nanotechnologies are 
dangerous) that is to be argued. Arguments are judgments that are expressed regarding a statement. A set 
of arguments for a thesis is called an argumentation. 

Today forums, chats or emails are used to debate via the web. We have decided to build a different system 
using annotation because it can precisely localize the part of a text that a user wants to comment (or argue 
upon). 

Definition of Annotation : An annotation is a data attached to a document or a part of a 
document. 

We had first developped ad-hoc annotations systems for our first and second experiment platforms (Be- 
tapolitique was built with SPIP www.spip.net, and ECAP website was built with XWiki www.xwiki.com). 
For our third experiment, we have developed a solution based on Annotea protocol (www.w3.org/2001/ 
Annotea) and Annozilla (Annozilla is a client for the Annotea protocol developped by Mozilla for firefox 
web browser annozilla.mozdev.org). This solution is currently a prototype and is independent of website 
platforms. 

There are other annotation systems existing (we recommend the lecture of [5j ) but choosing Annotea 
was done for the following reasons : 

• It allows to annotate HTML documents. 

• Annotea is a w3c web standard protocol. This guarantees interoperability. 

• Annotations can be stored in RDF database. 

• This is an asynchronous solution based on client-server architecture. 

We have added to the current Annozilla implementation the possibility to design forms for annotation on 
a specified category of texts. In our experiments, an argument is an " illocutionary-act" . The statement 
is selected in a document and must be rephrased to be judged, and user has to justify his act by a comment. 



2 



1.3 Experimental protocol 

This section deals with the experimental protocol we have built from our experiments. Judgments and 
relations between judgments are defined with respect to the community of users, the subject of the debate, 
and the categories of documents. A body of documents is created. Users read documents and can annotate 
to express their point of view and argue. They select and rephrase a statement in a document, state their 
judgement on it and justify it. Then, each argument can be discussed. When the protocol ends, a summary 
of the debate must be produced. 

1. Define a subject for the debate. 

2. Create forms for annotation (define judgments users can choose). 

3. Reading documents. 

4. Production of arguments. 

5. Discussion of arguments (there is a loop between the fourth and fifth step cause this discussion leads 
to produce new arguments). 

6. End of the experiment, production of a summary 

In a following section of this document, we present three experiments. Criterias given to compare these 
experiments are : 

• Subject of the debate. 

• Categories of documents. 

• Do users know each other ? 

• Links between judgments. 

• Aim of the debate (Is this debate going to produce a new document?). 

• Duration of the experiment. 

• Content of justifications (is there a model of a justification for a kind of judgment?). 
Aim of each experiment: 

1. First experiment was done as a test to see if it is natural to use judgments to annotate. 

2. Second experiment was done as a test to see if users rephrase their selection and justify their judgment. 

3. Third experiment was done to test the structure that is itself based on the n-opposition theory. 

2 Relations between arguments and n-opposition theory 

The annotation forms we have designed force users to make a judgement. We propose to use structures of 
the n-opposition theory to define relations between judgments. Experiments are to confirm if users naturally 
respect or not these structures (Do users respect the structure without explanation?). 

This section presents the n-opposition theory and structures we designed for our three experiments. 
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2.1 The n-opposition theory 



To define relations between judgments, we design a n-opposition structure based on the n-opposition theory 
This theory is a geometrical generalisation of Aristotle's classical opposition theory. The most famous 
structure of Aristotle's opposition theory is Aristotle's logical square of oppositions. 




Figure 1: traditional Aristotle^s logical Figure 2: Aristotle square of opposition in 

square of opposition predicate logic 

Figure 1 shows four kinds of relations (arrows and colored line) between four judgments, traditionally rep- 
resented by letters A,E,I,0. A and E represent universal judgments (A is the affirmative universal judgment, 
E is the negative universal judgment). I and O represent particular judgments (I is the affirmative particular 
judgment, O is the negative particular judgment). Arrows between universal and particular judgments repre- 
sent relations of sub-alternation. The blue line between A and E represents a relation of contrariety. The 
green line between I and O represents a relation of subcontrariety. Red lines represent contradiction. 
Figure 2 shows an example of square of oppositions in predicate logic. 

Following definitions are quoted from [6]. 

• sub-alternation : it is defined as the impossibility of having the first term true without having also 
the second true. 

• contrariety : Contrariety between two terms is the impossibility that both terms are true, but the 
possibility that both terms are false. 

• sub-contrariety : Sub-contrariety is the impossibility that both terms are false, but the possibility 
that both are true. 

• contradiction : Contradiction between two terms is defined as the impossibility for them to be both 
true and both false. 

Today, our system doesn't assist users because we test if users naturally respect the structure. If a 
structure appears to be adapted for a debate and its users, it will become possible to assist users by signaling 
them when they violate the structure. 

The following section presents structures we tested in our experiments. 

2.2 Structures of opposition 

We defined six judgments for our first experiment. Two for a theoretical level : i agree, i don't agree. 
Two for a practical level : it works, it doesn't work. Two for an emotional level : I like, i don't like. 

We suggest a structure in which emotional level is a consequence of theoretical level and practical level is a 
consequence of emotional level. We considered instinct can be educated by theory and acts are consequences 
of instinct. 
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I agree \ don't agree 




Figure 3: structure of opposition for the betapolitique experiment 

D.Luzeaux [6j shows how to translate a n-opposition structure into an epistemistic logic. We had found 
modalitites of a defeasible logic introduced in [Ij organized in a n-opposition structure according to their 
definitions. This structure looks like the one we designed for the experiment. Defeasible reasonings deals 
with confiictual statements. Defeasible logics were introduced by D.Nute [8j. 

A defeasible theory is a triple (F,R,>) where F is a set of facts, R a set of rules and > a superiority 
relation. There are three kinds of rules, strict rules, defeasible rules and defeaters. 

1. Facts are a set of literals and represent indisputable knowledge . 

2. Strict rules are denoted by A— > B and are interpreted in the classical sense. 

3. Defeasible rules are rules that can be defeated by contrary evidences. 

4. Defeaters are rules that cannot be used to draw any conclusions. Their only use is to prevent conclusions. 
In other words, they are used to defeat some defeasible rule by producing evidence to the contrary. 

5. A superiority relation on R is an acyclic relation > on R. rl > r2 expresses that rl may override r2 if 
they lead to conclusive decision that contradict each other. 

A conclusion in a defeasible theory D is a tagged litteral with one of the following modality: 

1. +A(7 means that q is definitely provable in D. q is proved with only facts and strict rules. 

2. — means that q is not definetly provable in D. q is not proved with only facts and strict rules. 

3. means that q is defeasibly provable in D. A defeater to contradict q can exist. The superiority 
relation leads to conclude q before ^q. 

4. —5q means that q is not defeasibly provable in D. No set of rules lead to conclude q or for every set of 
rules leading to conclude q, the superiority relation leads to conclude ^q before. 

5. -^^apq means q is provable with ambiguity in D. There is a set of rules that can lead to conclude q. 
The superiority relation is not taken into account. 

6. —Sapq means that q is not provable even with ambiguity in D. There is no set of rules that can lead to 
conclude q. 
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Figure 4: structure of opposition for a defeasible logic 

However, we didn't look any deeper to confirm the matching between these two structures. This obser- 
vation was the result of intuition. In our experiments, we focused on defining structures and testing their 
efficiency. Translation of n-opposition structures into logic is one of our future task. 

For the second experiment (ECAP), we had defined six judgments: 

• I agree, I don't agree to judge a statement on its purpose. 

• Correct syntax, uncorrect syntax to judge a statement on its syntax. 

• This confirms, this contradicts to add supporting references or contradictory references to the 
statement. 

Judgments were just opposed by contradiction. The Aim of this experiment was to test if users would 
accept to rephrase their selections and justify their judgments and we didn't propose a complete structure. 
For the third experiment (Intermed), we proposed three levels of judgments : 

1. Proved 

2. Unclear 

3. incorrect 

For each annotation, students had to judge with a combination of an affirmative or negative judgment 
per level (yes it is proved or no it is not proved and yes it is unclear or no it is not unclear and yes it is 
incorrect or no it is not incorrect). We tested relations of sub- alternation of the figure 5. 
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Proved Unclear Uncorrect 

not unclear not uncorrect not proved 

and and and 

not uncorrect not proved not unclear 




Figure 5: structure of opposition for the Intermed experiment 



3 Experiments 

3.1 Conditions of experiments 

Before dealing with results and observations of experiments, we present context of these experiments. For 
the first experiment, we worked with the development team of betapolitique. Betapolitique is a web blog of 
politic news. The duration of experiment was three months (February to may 2007) during French presidential 
elections. No help nor explications were provided to users. There was no objective nor a subject of debate 
defined. Users of betapolitique are anonymous to each other and were not forced to participate. They could 
read their arguments on the right of the article (figure 6) and use a treemap (developed by the society Pikko 
www.pikkosoftware.com) to see which article was the most annotated (figure 7). 



Segolene Royal : les 100 propositions du pscre 

3 mars 200716:32 

A_PROPOS : ""26- Reviser la carte scolaire pour supprimer les 
ghettos scolaires, assurer la mixite sociale et constituer des 
reseaux d'education prioritaire. MON AVIS : 

ENTHE0RIE_21 idealement, j\nllieie totalement 

ARGUMENJA! RE vo\c\ mon argumentation : la mixite devient 
naturelle pourtous ceux qui I'ont vecue ainsi I'ecole est LE lieu 
ideal pour qu'enfin les diflferentes cultures cohabitant en franco 
deviennent un avantage. 



Repondre a ce message 

fsegolene Royal : les 100 propositions du pacte 
presidentiei 

1 er avril 2007 1 0:37, par jean 



Instlnctlvement, j'alme, void mon argumentation : 

enfin, un jeune content d'avoir appris a vivre dans un monde 
multiculturel 



Figure 6: screenshot of annotations for Betapolitique 



Betapolitique blog politique connectif 

Chroniques pecry'ptages ]Participer ]Rti-Veilles |Ressources | 



Segolene Royal : les 
100 propositions du 
pacte presidentiet 

dimanche 1 1 fevrier 2007 




Themes ; SegolErie Royal 



Repondre a cet article 

La candidate socialiste a devoile aujourd'hui, a Tissue 
d'un grand discours programme cloturant la pliase de 
consultation des « debats participatifs », un ensemble de 
100 propositions constituant le socle de son « pacte 
presidentiel ». 
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Figure 7: A treemap to visualize annotated documents 



For the second experiment, we collaborated with the organization committee of ECAP congress. The 
web site of ECAP was designed to read and discuss texts of the speakers of the congress. The experiment 
begun few days before the congress and ended to the end of the congress (but the website still exists). A 
tutorial is accessible. Participants of the congress were unknown each other. Their arguments were displayed 
on the right of the text and corresponding selections were highlighted into the text (figure 8). The goal of 
the debate was to enhance the quality of presentations by taking into account remarks from others. 




By ticking the box, annotations 
appear in the abstract below. They 
are colour coded to identify thejand 
of annotations there are referring to. 



3 annotations on ideas that can be 
expanded to see more details 



Figure 8: screenshot of annotations for ECAP 
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Figure 9: A graph to cartography debates based on opposition 

For the third experiment, a group of experts of the domain of nanotechnologies wrote a body of documents 
to answer the fohowing questions : 

1. Do nanotechnologies reahy bring innovations or is it just a buzzword for weh known technologies? 

2. Are nanotechnologies a chance for the developping countries, or is it still another divide between north 
and south? 

3. Is it sacrilege or progress to let nanotechnologies alter human nature? 

4. Do the nanosciences and nanotechnologies harbor still unknown risks? What is a responsible attitude : 
should research be stopped and the precautionary principle be applied, or should we be confident that 
further research will identify the actual risks and provide means to control them? 

5. Is the lack of proof that nanotechnologies are harmful or harmless a justification for pursuing production 
and research, or is it a justification for stopping them? 

These texts were the documents that students have annotated. The subject of the debate was : Should 
we write a moratorium on nanosciences and nanotechnologies? And the goal was to produce a summary of 
argumentations. The experiment was done during two class sessions. Our team was present to assist them. 
Their annotations were listed on the left of the texts. The parts of text discussed were highlighted by a 
background color (fig 10). 









I 1 


L'lioiume aiigmeaLe 
Anteur : Nayla Farouki 






a'annolalion 



















Figure 10: A screenshot of annotations for Intermed 
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' Betapolitique 


ECAP 


Intermed 


(^irici oi documents 


political articles 


philosophical acts 


isQal or scietittftc texts pf 

experts 


Help 


none 


Tutorial 


support of our team 


Duration 


3 months 


a weak ( the S fast days 
was the congress) 


2 meetings ot 2 hours 


©oat 


.noiTii 


Ip Improve presentations 


write a summary 








Should a moratorium on 
nanotechnolpgy be 
written? 






don't know each others 


students of a same ctass 






An noted text wa? 
hlghlf^t^, C0rto9raf3J>y of 
oppos^fons 


Annoted text was 
highlighted 



Figure 11: Comparison of conditions of experiments 



Each of these experiments made evolve our experimental protocol. We decided to define a subject of 
debate for the third experiment. Maybe, to not define clearly a subject for the two first experiments was the 
reason of the lack of discussions whereas in the third experiment, each argument was discussed. 

It appeared clearly for the second experiment that judgments have to be defined depending the commu- 
nity. For the third experiment, we defined judgments depending the subject of the debate. We are now 
convinced that judgments must be defined depending the categories of documents. People don't judge scien- 
tific statements the same way as philosophical statements. 

With the second experiment we introduced the obligation to rephrase the selection. This enhances com- 
prehension between users. A judgment is associated to the new statement (rephrasing the selection) , not to 
the selected part of document. So, even if there is a misunderstanding of the selected part of document, user 
precise the statement he judge. 

3.2 Observations and results 

We present in this section the conclusions of these three experiments. 

The first experiment confirmed the use of judgments and the choice of annotation as a solution for 
implementing debate. We had 870 annotations for three months of experiment. Judgments were all adopted 
(figure 12). 





percent 


Mike 


147 


16,9 


Idofi't like 


127 


14,6 


J Eigree 


120 


13,79 


1 don't agree 


85 


9,89 


It works 


115 


13,22 


It doesn't work 


162 


18.62 " 


ethers 


113. 


12.99 


im 


870 


100 



Figure 12: Repartition of judgments in betapolitique 

The second experiment validated the need of an ergonomic interface and of a gratification function. The 
goal of the experiment was not taken into account by participants. We did interviews as well as polls and 
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the general feeling was that the idea is interesting but the tool is too complicated to be used. We analysed 
frequencies of visit on the site through Google analytics tool (www.google.com/analytics). The Congres was 
held from the 16th to the 18th of June 2008. The highest number of visits appened on the 16th of June, 147 
visitors for 80 participants registered to the congress. We had 306 visitors from the 15th to the 19th of June. 
The average time of visit during this period was of four minutes. Though we had so much visitors, we had 
only 95 annotations, most of them done before 19th June. The text the most annotated has been annotated 
7 times (there were 70 texts). Nearly nobody attempted to discuss through the tool. 



I Exporter ^ | | B E-fnail | | Ajouter gu tableau de bord, | 

Vue d'ensemble des visiteurs 

J ^ visiteurs - | 



Segments avarices : | Toutes les visites, ^ | 

15 juin 2008 - 19 juin 2008 ^ 

Graphlque par : Islj 



1 2 juin zoos i«juin2aaa 

306 internautes ont visite ce site. 





485 Visites 


^-'^ 


306 Visiteurs uniques absolus 




2 252 Pages vues 




4,64 Nombre moyen de pages vues 




00:03:52 Temps passe sui" le site 




47,01 % Taux de i ebond 




51,96 % Nouvelles visites 



Segmentation des visiteurs 

^ Profil des visiteurs : langue(s), fournisseurs d'acces, Valeurs 
personnalisees 

rn Type de navigateur : navigateurs, systemes d'exploitation, 
navigateur et systemes d'exploitation, couieurs d'ecran, 
resolutions d'ecran, types de prise en charge de Java, Flash 

@ Synthese geographique 

Viaualisation de la carte 



l^i^j^ssj Essayer I'Optimiseur de site 

Figure 13: Statistics of visits of ECAP website 



The third experiment validated the interest of rephrasing the annotated statement. The most interest- 
ing observation is the fact that there seems to be models of justifications for judgments. Users adopt the 
same kind of locution for a same combination of judgments to justify their choice. Satisfaction, interest and 
evolution of the opinions were evaluated with a survey. Most of students have appreciated the quality of 
debates using our tool. They suggested enhancements for the tool that are possible with our technological 
and conceptual choices. 

Most of the arguments are of ethical content. They are on managing risks or on managing confiicts 
between nanotechnologies potential danger and public health. Opinions become more precise with con- 
troversies. They made 39 arguments during the first session and 19 during the second one. Each argument 
was systematically discussed. The content of justifications leads to the following conclusions: 

• If a statement is tagged proved, the justification explains the statement. 

• If a statement is tagged incorrect, the justification is a negative reason. 

• If a statement is tagged with two criteria ( proved and unclear or proved and incorrect), the justifi- 
cation shows a contradiction and suggests a new direction. 

• If a statement is tagged not incorrect, unclear and not proved, the justification is expression of a 
belief or of a conviction. 

If these results are confirmed by more experiments, it means that we can guide users in justification of 
their choices of judgment. 41 annotations were well- formed ( i.e a judgment per level), the figure 14 presents 
the repartition of these annotations with respect to relations of sub-alternation of our structure. 
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Proved 



Unclear 



Uricofrect 



4/28 
6/13 



10/28 I 1/28 I 

y 4/13 ^ WU ^ 



not unclear not uncorrect not proved 

m4 atTid ar^ 

not uncorrect not 0rov^ hot undi^ 

Figure 14: Sub- alternation in Intermed 



3.3 Desire and pleasure 

Notions of desire and pleasure have appeared during our experiments. Desire is an impulsion for users to 
participate. Pleasure is a satisfaction, a gratification. The third experiment was the most representative of 
the need to not neglect these notions. Every frustration (misunderstanding of the software, technical issues, 
lack of information) can block the participation but an ergonomic interface (nice and easy to use) can enhance 
desire to debate. Pleasure depends on quality and goal of the debate. Reasoning and arguing, clarifying one's 
own opinion and producing a summary of one's argumentation are pleasurable activities. These two notions 
(desire and pleasure) deserve more attention in our future works. But we have seen we could mesure desire 
and pleasure with poll. Students of the Intermed experiment attributed an average mark of 4/5 for the 
quality of the debate and of 3,5/5 for the ergonomy and the interest of the website. 



4 Conclusion 

Facing the lack of web 2.0 solutions to make debates of quality, we propose to create web tools founded on 
logic to enhance debates structure and comprehension. In our solution, arguments are justified judgments 
on statements. The experiments we presented show that our model of argumentation is natural and easy 
to adopt. The n-opposition theory is a geometrical tool we use to define relations between judgments and 
to categorize relations between arguments. That's a first step to describe reasonings. The third experiment 
showed that it is possible to define for each judgment an "illocutionary-act" . We can associate an interpre- 
tation to each judgment. But, is it natural to represent a judgment with a logical modality? What kind of 
logic can express relations between judgments? 

In our future experiments, we suggest the implementation of an help system that will suggest to users a 
form of justification for their judgments. We have to define notions of desire and pleasure in the context of 
the debate. We want to develop an agent founded on n-opposition and logic for helping users when reasoning. 
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